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Abstract 


The  goal  of  this  research  is  the  development  of  new  fundamental  insights  and  methodologies  to  exploit 
structural  properties  of  large-scale  dynamical  networks  in  order  to  quantify  their  inherent  fundamental  lim¬ 
its  on  performance  and  robustness  and  characterize  their  resulting  fundamental  tradeoffs.  The  primary  focus 
of  the  project  was  on  revealing  foundational  role  of  underlying  dynamical  structure  and  sparse  information 
structure  of  large-scale  dynamical  networks  in  emergence  of  severe  theoretical  fundamental  limits  on  the  re¬ 
sulting  performance  and  robustness  in  such  networks.  Our  research  results  provide  a  novel  unified  approach 
for  analysis  and  synthesis  of  large-scale  dynamical  network.  We  have  developed  an  axiomatic  general  the- 
ory  of  systemic  measures  for  performance  and  robustness  analysis  and  synthesis  of  large-scale  dynamical 
networks.  The  proposed  theory  evolves  around  introducing  the  new  classes  of  convex  and  Sch ur-convex 
systemic  measures  that  capture  transient,  steady -state,  macroscopic,  and  microscopic  features  of  dynamical 
networks.  The  notion  of  systemic  measure  provides  a  unifying  umbrella  under  w'hich  an  integrated  theory 
of  hard  limits  based  on  operator,  graph,  optimization  theories  can  be  developed  to  systematically  deal  with 
uncertainty,  performance,  and  robustness  in  distributed  control  and  dynamical  systems.  Our  research  re¬ 
sults  are  highly  relevant  for  analysis  and  synthesis  of  engineered  and  natural  dynamical  networks.  In  the 
following  pages,  T  will  briefly  explain  our  theoretical  achievements.  More  details  have  been  provided  for 
selected  number  of  topics.  Proper  citations  to  our  published  papers  have  been  provided  for  further  details 
and  readings. 
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Emergence  of  Fundamental  Limits  in  Spatially 
Distributed  Dynamical  Networks  and  Their  Tradeoffs 

Summary  of  Accomplishments  and  Research  Results 

1  Systemic  Performance  and  Robustness  Measures 


One  of  the  simplest  class  of  dynamical  networks  that  our  proposed  methodology  can  be  explained  in  a 
simple  setting  is  the  class  of  first-order  linear  consensus  networks  with  the  following  dynamics 


±(t)  =  -£$a:(t)+£(i) 

y(t)  = 


0) 

(2) 


where  x(^}7  y(f)  £  Rn  are  the  state  variable  and  output  of  the  dynamical  network,  respectively.  The  n  x  1 
vector  of  all  ones  is  denoted  by  ln  and  x(t)  is  the  average  of  all  state  variables  , ,  ?£n(£).  The 

exogenous  disturbance  input  £(f)  captures  the  uncertain  effect  of  the  environment  on  the  dynamics  of  the 
network,  which  is  assumed  to  be  a  zero-mean  Gaussian  white  noise  with  unit  covariance.  This  dynamical 
network  is  defined  over  a  graph  Q  =  where  V(Q)  is  the  set  of  nodes  and  E(Q )  is 

the  set  of  edges.  The  weight  function  is  a  map  that  ts  defined  from  the  set  of  edges  to  the  set  of 
strictly  positive  real  numbers  and  it  captures  the  coupling  structure  of  the  underlying  dynamical  network. 
The  Laplacian  matrix  of  the  underlying  graph  of  the  network  is  denoted  by  Lg .  The  Laplacian  matrix  is 
a  positive  semidefinite  matrix  and  can  be  used  to  find  many  properties  of  the  corresponding  graph.  The 
{i:  i)  diagonal  element  of  the  Laplacian  matrix  is  equal  to  the  sum  of  the  weights  associated  to  every  edge 
incident  to  node  i  and  its  (i,  j)  oflf-diagonal  element  is  equal  to  weight  of  edge  connecting  nodes  i  and  j, 
otherwise  it  is  equal  to  zero.  In  the  following  discussions,  we  assume  that  all  underlying  graphs  are  finite, 
simple,  undirected  and  connected,  and  therefore,  the  smallest  Laplacian  eigenvalue  is  always  equal  to  zero. 
Therefore,  the  dynamical  network  (!K2)  is  marginally  stable.  However,  this  network  is  well-defined  and 
its  marginally  stable  mode  is  not  observable  from  the  output. 

The  linear  dynamical  network  ( 1  )-(2)  can  be  viewed  as  a  system  that  has  been  already  stabilized  by  a 
linear  state  feedback  control  law  and  operating  in  closed-loop.  The  sparsity  pattern  of  the  Laplacian  matrix 
Lg  is  imposed  by  the  topology  of  the  underlying  graph  Q  and  the  corresponding  weight  function,  which 
models  the  coupling  structure  and  strength  among  the  subsystems  in  the  closed-loop  system.  The  existence 
of  such  inherent  sparsity-constraints  on  the  topology  of  the  underlying  graphs  play  a  foundational  role  in 
emergence  of  severe  theoretical  fundamental  limits  on  the  global  performance  and  robustness  of  this  class 
of  dynamical  networks.  We  use  the  following  simple  but  illustrative  example  to  conceptualize  the  idea. 

Example:  Let  us  index  the  Laplacian  eigenvalues  in  ascending  order  Xi  <  \2  <  -  -  *  <  An,  where  the 
smallest  eigenvalue  X\  is  always  equal  to  zero  for  connected  graphs.  The  steady  state  variance  of  the  output 
of  the  network  (!)-(2)  is  an  example  of  a  performance  and  robustness  measure.  This  measure  quantifies  the 
expected  dispersion  of  the  state  of  the  network  in  state  steady  [26]  and  is  indeed  equal  to  the  W2“tiorm  of  the 
system  from  the  disturbance  input  to  the  output  of  the  network  and  can  be  calculated  in  terms  of  Laplacian 
eigenvalues  as  follows 


1 

2 


(3) 


1 


Figure  1 :  Among  all  connected  graphs  with  five  nodes,  the  value  of  the  systemic  measure  (3)  is  (a)  maximal  for  a 
path  graph  among  all  graphs  as  well  as  among  all  tree  graphs,  (b)  minimal  for  star  graph  among  all  tree  graphs,  and 
(c)  minimal  for  a  complete  graph  among  all  graphs. 


where  E[ .  ]  is  the  expected  value  operator.  Figure  1  shows  a  simple  but  illustrative  example  that  how  measure 
(3)  depends  on  the  topology  of  the  underlying  graph  of  networks.  In  our  results,  we  take  an  axiomatic 
approach  to  classify  several  important  performance  and  robustness  measures  for  Linear  consensus  networks. 
Let  us  represent  the  set  of  all  linear  consensus  networks  in  the  form  (l)-(2)  that  have  a  common  initial 
condition  xq  by  9T(:ito)-  Therefore,  every  dynamical  network  in  vTl(a:o)  can  be  represented  using  its  Laplacian 
matrix  using  symbol  jV(Lg). 

Definition  1  For  every  given  j\f(Lgv ) ,  Ar(  Lg2 )  £  (a'o),  the  addition  and  scalar  multiplication  operations 

on  9I(#q)  is  defined  as  follows: 

(i)  Af(LGl)  +  N{Lgf)  =M(LSl  +  £&) 

(ii)  off  ( Lg  j )  =  J\f  (  a  Lg^  for  a  1 1  pos i t  ive  sea  la  rs  a . 

The  addition  operation  of  two  linear  consensus  networks  is  equivalent  to  the  edge  union  operation  on  the 
underlying  graphs  of  the  two  networks.  The  scalar  multiplication  operation  of  a  linear  consensus  network  is 
equivalent  to  scaling  the  weight  function  of  the  underlying  graph.  Let  us  denote  Lg  io  be  the  Moore-Penrose 
pseudo-inverse  of  Lg ,  which  is  a  square,  symmetric,  doubly-centered  and  positive  send  definite  matrix. 

Definition  2  (Convex  Systemic  Measures)  For  a  given  space  of  linear  consensus  networks  01  (xo),  a  sys¬ 
temic  measure  is  an  operator  p  :  Ot(xo)  — ¥  R+  with  the  following  properties: 

(i)  Positive  homogeneity  of  degree  — 1:  p(Kff{Lg1))  —  k~1  pfj/VfL^))  for  all  n>0, 

(ii)  Monotonicity:  If  JfQx  <  Vg2  then  p(Af(Lg1 ))  <  p(M{Lgf)), 

(iii)  Convexity:  p(M(aLg1  +  (1  -  a)Lg2))  <  ap{Jf(Lgf))  -f  (1  -  a)p(A/"(£g.2)), 

for  all  Af(L£2)  £  01(xo)  and  all  0  <  a  <  L 

The  monotonicity  property  implies  that  a  systemic  measure  p  is  subadditive  over  the  set  of  all  linear 
consensus  networks.  This  property  can  be  interpreted  as  a  fundamental  tradeoff  between  systemic  measures 
and  sparsity  of  the  underlying  graph.  If  we  add  more  edges  to  an  existing  graph,  the  value  of  the  systemic 
measure  will  decrease  [3,4],  The  homogeneity  property  implies  that  among  all  graphs  with  identical  inter¬ 
connection  topologies,  the  ones  with  larger  (stronger)  coupling  weights  have  smaller  systemic  measures. 

Zeta  function  based  convex  systemic  measures:  These  important  class  of  systemic  measures  are  defined 
using  the  spectral  zeta  function  of  Laplacian  eigenvalues  of  the  underlying  graph  as  follows 

P<p(Wg))  :=  k[Cp{Lg)]K  (4) 
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for  all  1  <  p  <  oo  and  k  >  0,  where  the  corresponding  zeta  function  of  the  dynamical  network  (I  )-(2)  with 
Laplacian  eigenvalues  A  *  fori  =  2 is  defined  by 

Cp(Lg)  :=  Tr((4)P)  =  £  \~p,  (5) 

i“2 

where  Tr{.)  is  the  matrix  trace  operator.  In  our  results,  we  show  that  (4)  is  a  convex  systemic  measure 
according  to  Definition  2  that  includes  several  well-known  performance  and  robustness  measures  as  its 
special  cases  [1,3].  When  p  — y  oo  and  k  —  1,  the  systemic  measure  reduces  to  A^1,  where  A2  is  the 
algebraic  connectivity  of  graph  Q ,  This  systematic  measure  approximately  measures  the  convergence  time 
of  the  consensus  process.  For  p  —  1  and  k  —  the  systemic  measure  (4)  is  equal  to  the  square  of  the 
?/2^norm  of  the  first-order  linear  consensus  network  (see  equality  (3)),  and  when  p  =  2  and  k  =  its 
value  is  equal  to  the  ^2_riorm  of  a  second-order  linear  consensus  network  [  1  ]. 

Practical  interpretations  of  systemic  measures:  In  [26],  we  show  that  H2-based  systemic  measures  have 
interesting  physical  interpretations.  In  a  synchronous  power  grid  subject  to  a  random  initial  condition  (dis¬ 
turbance)  ,  the  corresponding  T^-based  systemic  measure  is  equal  to  the  total  resistive  power  loss  in  the 
network.  This  implies  that  in  order  to  render  all  states  to  the  consensus  state  some  resistive  power  must  be 
wasted  throughout  the  network.  Our  results  show  that  the  least  achievable  values  of  the  resistive  power  loss 
in  a  power  grid  is  lower  bounded  by  some  constants  that  only  depend  on  the  characteristics  of  the  underlying 
graph  of  the  network.  Another  result  in  our  paper  [26]  shows  that  7^-based  systemic  measure  for  a  group 
of  autonomous  vehicles  participating  in  a  formation  is  equal  to  the  total  kinetic  energy  required  to  render  the 
entire  group  to  the  consensus  state.  We  are  currently  investigating  to  find  practical  interpretations  of  various 
systemic  measures  in  dynamical  networks. 

Remark  1  The  value  of  systemic  measure  (4)  for  isospectral  graphs,  graphs  with  identical  set  of  eigenval¬ 
ues,  are  equal  This  is  one  of  our  research  thrusts  for  next  year. 

The  concept  of  convex  systemic  measure  can  be  extended  further  by  considering  the  following  class  of 
measures  that  are  defined  based  on  notion  of  Schur-convex  functions. 

Definition  3  (Schur-convex  systemic  measures)  For  a  given  space  of  linear  networks  a  schur- 

convex  systemic  measure  is  an  operator  p  :  Ot(.ro)  — >  R+  that  satisfies  monotonicity  property  (iij  and 
convexity  property  (Hi)  in  Definition  2  and  is  also  orthogonally  invariant,  i,e.t 

p(S{Lg))  =  p(M(ULgUT)), 

for  ail  orthogonal  matrices  UUT  —  UTU  —  In . 

'Hp-based  Schur-convex  systemic  measures:  For  a  given  linear  consensus  network  A^(Lq)  G  ^(xq), 
suppose  that  G(s )  €  Cnxn  is  the  transfer  function  of  Af{Lg)  from  disturbance  input  to  its  performance 
output.  Our  research  results  in  [3]  show  that  the  following  class  of  performance  and  robustness  measures 
are  Schur-convex  systemic  measures  according  to  Definition  3: 

/  I  r°°  \ 

PHp(Wg))  :=  ||G||Wp  =  (-t  .  (6) 

where  the  Schatten  p-norm  for  every  1  <  p  <  00  is  defined  using  the  singular  values  of  G(jbj )  by 
l|G(jw)||£.  =  £?=1  eri(G(ja/))p.  When  p  =  00,  this  systemic  measure  is  equal  to  A2l,  which  is  in 
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fact  the  input-output  Hoo-norm  of  the  network.  This  measure  can  be  viewed  as  the  maximum  system  gain 
when  inputs  are  taken  over  all  measurable  signals  with  finite  energy.  For  a  given  linear  consensus  network 
A f(Lg)  e  v^(ao)>  the  Hp- based  systemic  measure  (6)  characterizes  performance  and  robustness  properties 
of  a  network  from  an  input-output  system  theoretic  perspective.  On  the  other  hand,  the  zeta-functi on-based 
systemic  measure  (4)  can  be  related  to  structural  properties  of  the  underlying  graph  of  the  network  .  Out  re¬ 
search  results  [1,3]  show  that  there  is  an  inherent  relationship  between  these  two  class  of  systemic  measures 
and  each  one  can  be  calculated  by  knowing  the  other  one. 

Schur-convex  systemic  measures  generated  by  Schur-convex  sums:  The  second  important  class  of 
Schur-convex  systemic  measures  is  generated  by  sums  of  convex  decreasing  functions  (also  known  as 
Schur-convex  sums)  of  Laplacian  eigenvalues  [3j.  Suppose  that  /  :  M_|_  — >  JR  is  a  decreasing  convex 
function.  For  every  Af(Lg)  £  ^(^o),  the  class  of  measures  that  are  defined  by 
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PEf{^(LQ})  =  0) 

are  Schur-convex  systemic  measure.  For  example,  all  measures  generated  by  /(A)  =  X~p  fall  into  this 
category.  This  includes  Ho-tiorrn  of  the  first-order  and  second-order  linear  consensus  networks  correspond 
to  convex  functions  for  p  =  1.2.  Another  important  class  of  Schur-convex  systemic  measures  is  the  class  of 
entropy-based  measures  for  linear  consensus  networks  that  are  generated  by  /(A)  =  -  log  A,  which  can  be 
interpreted  as  a  measure  of  uncertainty. 

Our  research  results  [1,3]  show  that  convex  and  Schur-convex  systemic  measures  can  be  related  to  the 
structural  properties  of  the  underlying  graph  of  dynamical  networks.  In  some  applications,  it  may  not  be 
possible  to  express  explicitly  the  corresponding  systemic  measure  in  terms  of  the  structural  properties  of  the 
underlying  graph  of  the  network.  Therefore,  we  have  developed  a  novel  methodology  to  obtain  tight  lower 
and  upper  bounds  for  the  class  of  systemic  measures*  in  the  following,  some  of  the  key  ideas  behind  our 
approach  along  with  some  selected  results  are  explained. 


1,1  Fundamental  Limits  on  the  Best  Achievable  Systemic  Performance  and  Robustness 

For  a  given  dynamical  network  M(Lg)  E  91(xq)  with  underlying  unweighted  graph  Q  that  consists  of  n 
nodes,  the  maximal  and  minimal  values  of  the  zeta-fu  net  ion-based  systemic  measure  are  bounded  by 


(n-  l)15 

2\/  <5 1  +  ^2 


<  pCl(W(Lff)) 


< 


n  —  I 
2T7. 


1  + 


(2)  “  m) di 
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where  m  is  the  total  number  of  edges,  di  is  the  degree  of  node  i,  and  6CV  :=  Yli Li  df  for  a  —  1,2.  The 
diameter  of  Q  is  denoted  by  diam(C?},  which  is  basically  the  longest  shortest  path  in  the  graph.  This  result 
was  reported  in  [  1  j  that  shows  explicitly  how  the  value  of  a  systemic  measure  depends  the  microscopic  (e.g*, 
degree  nodes)  and  macroscopic  (e.g.,  graph  diameter  and  total  number  of  edges)  features  of  the  underlying 
graph  of  the  network*  According  to  (3),  we  can  quantify  fundamental  limits  on  the  best  achievable  H 2-norm 
of  a  dynamical  network  with  arbitrary  interconnection  topology  as  follows 


~h-  <  \j'pp 


(9) 


These  bounds  represent  hard  limits  and  scale  with  the  size  of  the  network.  The  lower  bound  is  achieved 
iff  Q  is  a  complete  graph,  and  the  upper  bound  is  achieved  iff  Q  is  a  path  (chain)  graph.  One  can  extract 
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more  detailed  information  about  performance  and  robustness  properties  of  dynamical  networks  by  exploit¬ 
ing  the  specific  structural  properties  of  their  underlying  graphs.  For  instance,  let  us  consider  the  class  of 
linear  consensus  networks  with  at  least  five  nodes  and  tree  interconnection  topologies.  The  7i 2-norm  sys¬ 
temic  measure  of  such  networks  is  always  worse  (greater)  than  (n  —  l)/\/2n  and  always  better  (less)  than 
1)/12.  The  lower  hard  limit  is  achieved  iff  Q  is  a  star  graph,  and  the  upper  hard  limit  is  achieved  iff 
G  is  a  path  graph.  These  hard  limits  imply  that  the  T^-based  systemic  measure  of  linear  consensus  networks 
with  tree  structures  scale  with  0(\^n)  as  n  — >  oo. 

The  inherent  fundamental  limits  on  performance  and  robustness  in  dynamical  networks  can  also  be 
quantified  in  terms  of  macroscopic  features  of  the  network,  e.g,,  spectral  properties  of  the  underlying  graph. 
We  explain  one  of  our  interesting  results  by  limiting  our  discussion  to  the  class  of  S  chur-convex  systemic 
measures  (7)  with  an  additional  assumption  that  /(A)  — >  0  as  A  — >  oo.  For  a  given  dynamical  network 
jV(Lg)  £  0 t(.To),  we  construct  a  new  dynamical  network  by  only  adding  at  most  k  new  arbitrary  weighted 
edges  to  the  underlying  weighted  graph.  If  we  denote  the  resulting  network  by  jV(Lgew),  then  there  is  a 
fundamental  limit  on  the  best  achievable  values  for  the  systemic  measure  of  the  new  dynamical  network, 
which  is  quantified  by 

n 

pv {wr°))  >  E  /<A”ld)’  ao) 

%=k+2 

where  A?ld  for  i  =  k-\-2}  n  are  the  last  n  —  k  —  1  largest  Laplacian  eigenvalues  of  the  original  graph  of  the 
network  before  adding  new  edges.  This  result  implies  that  the  performance  and  robustness  of  a  dynamical 
network  cannot  be  improved  beyond  some  limits  by  increasing  the  connectivity  of  the  underlying  graph. 
The  lower  hard  limit  in  (10)  only  depends  on  some  of  the  Laplacian  eigenvalues  of  the  original  dynamical 
network  and  is  independent  of  the  weights  of  the  new  edges. 

The  existence  of  hard  limits  in  large-scale  dynamical  networks  motivates  us  to  discover  methodologies 
that  allow  us  to  improve  their  performance  and  robustness  by  optimizing  the  corresponding  systemic  mea¬ 
sures  and  trying  to  reach  the  best  achievable  hard  limits.  In  [31],  we  build  upon  these  notions  and  results  to 
investigate  a  general  form  of  combinatorial  problem  of  growing  a  linear  consensus  network  via  minimizing 
a  given  systemic  performance  measure.  Two  efficient  polynomial-time  approximation  algorithms  are  de¬ 
vised  to  tackle  this  network  synthesis  problem:  a  linearization- based  method  and  a  simple  greedy  algorithm 
based  on  rank-one  updates.  Several  theoretical  fundamental  limits  on  the  best  achievable  performance  for 
the  combinatorial  problem  is  derived  that  assist  us  to  evaluate  optimality  gaps  of  our  proposed  algorithms.  A 
detailed  complexity  analysis  confirms  the  effectiveness  and  viability  of  our  algorithms  to  handle  large-scale 
consensus  networks. 

1.2  Quantification  of  Tradeoffs  Between  Sparsity  and  Systemic  Measures 

The  underlying  dynamical  structure  of  a  network  depends  on  coupling  structure  among  the  subsystems 
which  are  usually  imposed  by  physical  laws  or  global  objectives.  For  example  in  linear  consensus  network 
(l)-(2),  the  Laplacian  matrix  represents  coupling  structure  in  the  closed-loop  system,  which  is  the  result 
of  sparse  information  structure  in  the  underlying  controller  array.  In  this  research  thrust,  we  focused  on 
revealing  foundational  role  of  sparsity  features  of  the  underlying  graph  of  networks  in  emergence  of  se¬ 
vere  theoretical  fundamental  limits  and  tradeoffs  on  the  resulting  performance  and  robustness  in  large-scale 
dynamical  networks.  Our  goal  was  to  discover  and  quantify  a  variety  of  mathematical  (Heisenberg-like) 
inequalities  explaining  such  fundamental  limits  and  tradeoffs.  In  our  research  results,  we  characterize  the 
inherent  tradeoff  between  some  classes  of  systemic  measures  and  sparsity  features  of  linear  consensus  net¬ 
works  with  unweighted  underlying  graphs.  Let  us  denote  the  adjacency  matrix  of  the  underlying  graph  of 
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network  (l)-(2)  by  Ag.  We  define  the  total  number  of  nonzero  elements  of  the  adjacency  matrix,  which  is 
denote  by  ||  Ag\\o,  as  our  sparsity  measure.  Wc  quantify  the  resulting  fundamental  tradeoffs  in  terms  of  this 
sparsity  measure  in  multiplicative  and  additive  forms  by 


p<i  (Lg)  ll^ello  > 


(»-D2 
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and 


/2p^(Lg)  l 
\  diam(g) 


< 


n(n  —  1) 
2~ 


where  diam(t/)  is  the  diameter  of  the  underlying  graph  and  n  is  the  size  of  the  network,  We  interpret  the 
implications  of  these  inequalities  by  considering  two  scenarios  for  dynamical  networks  with  the  same  size. 
The  inequality  in  the  left  asserts  that  the  minimum  (best)  achievable  levels  of  zeta-based  systemic  measure 
for  sparse  networks  is  higher.  For  all  dynamical  networks  with  identical  diameters,  the  inequality  in  the 
right  implies  that  the  maximum  (worst)  achievable  levels  of  systemic  measures  for  networks  with  more 
edges  is  smaller.  Among  all  networks  with  identical  number  of  edges,  the  ones  with  larger  diameters  have 
h  i g her  va lues  of  s y ste m i  c  mens u re s .  Pre v  i ou s  1  y ,  we  s h owed  t  h at  /l-  t  ( Lg )  =  ( Lg ) 2  >  Th eref ore,  t he 

above  fundamental  inequalities  explain  the  quality  of  disturbance  propagation  in  terms  of  sparsity  features 
of  linear  consensus  networks. 

In  [31],  we  extend  this  proposed  methodology  to  broader  classes  of  systemic  measures.  The  key  idea 
of  our  approach  is  based  on  the  monotonicity  property  of  systemic  measures.  This  property  implies  that  by 
improving  connectivity  of  the  underlying  graph  the  value  of  systemic  measure  decreases.  We  have  developed 
a  rigorous  mathematical  framework  to  quantify  the  interplay  between  systemic  measures  and  sparsity  more 
explicitly  using  tight  inequalities.  In  [20,33],  we  consider  general  linear  dynamical  networks  on  graphs 
(beyond  consensus  networks)  and  investigate  various  roles  of  sparsity  in  emergence  of  fundamental  limits 
and  tradeoffs  on  stability  and  performance. 


2  Sparsity  and  Spatial  Localization  Measures  for  Distributed  Networks 

The  research  results  presented  in  this  section  are  pushing  the  known  boundaries  in  spatially  distributed  sys¬ 
tems  towards  new  methodologies  to  study  sparsity  and  spatial  localization  in  large-scale  dynamical  network 
in  a  systematic  manner.  The  following  discussion  is  based  on  our  recent  work  reported  in  [27]. 

The  omnipresence  class  of  spatially  decaying  systems.  Typical  examples  of  spatially  decaying  systems 
include  linearized  models  of  spatially  distributed  power  networks  with  sparse  interconnection  topologies, 
linearized  models  spatially  distributed  networks  of  autonomous  agents  in  formation,  spatially  discretized 
models  of  infinite-dimensional  systems  with  partial  differential  operators  with  constant  coefficients,  and 
many  more.  In  our  research  results,  we  assume  that  the  underlying  spatial  domain  is  discrete,  i.e.,  G  =  Z 
and  the  state-space  operators  of  system 

=  Aip(t)  4-  Siift),  (11) 

y(t)  =  Cm  +  Du(t)  (12) 

are  infinite-dimensional  matrices.  In  order  to  understand  the  asymptotic  behavior  of  localization  techniques, 
we  quantify  spatial  decay  property  by  means  of  coupling  weight  functions.  The  Euclidean  norm  is  denoted 
by  |  .|.  A  positive  nondecreasing  function  w  on  Z  is  a  weight  function  if  it  satisfies:  w(k)  >  1  and  w(k)  = 
tu(  — k)  for  all  fc  G  Z. 

Definition  4  For  0  <  q  <  1,  the  coupling  weight  function  w  is  called  admissible  if  there  exist  a  companion 
weight  function  u>  an  exponent  0  6  (0,  1),  and  a  positive  constant  D  such  that 
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(a)  w(k  +  l)  <  w(k)u(l)  -j-  u(k)w(l)  for  all  kj  Eh, 

(b)  inf  |KhTjT]|i_£_  +  t  Huw-^l  -X[-r,r])IL  <  Dt'~6  for  all  t  >  1. 

The  function  X[  r.r]  is  the  characteristic  function  on  the  interval  j— r.  r].  The  first  condition  implies 
that  uj  is  submultlplicative,  Le.,  w(k  4-  /)  <  w(k)  w(l).  Typical  examples  of  admissible  coupling  weight 
functions  that  appear  in  various  applications  are  subexponential  weights  w(k)  =  for  a  >  0  and 

0  <  /?  <  1,  and  polynomial  weights  w(k)  =  (1  T  \k\)s  for  s  >  0*  More  general  weights  are  mixtures  of  the 
form  (1  -f  \k\)9  ( log(e  +  |&j))^  for  a  >  0, 

Definitions  For  a  fixed  exponent  0  <  q  <  oo  and  admissible  coupling  weight  function  w,  the  class  of 
matrices  SQtW(Z)  consists  of  all  spatially  decaying  matrices  A  ==  (a*j).  2  such  that  A  is  bounded  with 

respect  to  the  matrix  norm 

:=  max  |  sup  (  Y!  K'lM*  -  j)9)  ^ , sup  (  YL  M9' “(*  -  jT)  ( U3) 
t€Z  jez  ^eZ  iez 

/or  0  <  g  <  oo,  /v 

II  ^11  £«,,«(£>  :=  sup  1 0^111(1  -  j).  (14) 

ij'eZ 

/or  g  =  oo.  In  fact,  the  matrix  norm  (13)  is  a  quasi-norm  for  o  <  q  <  1. 

The  matrix  norm  inherits  the  key  submultiplicative  property  from  the  coupling  weight  function,  i.e., 
l|XB|U,lt„(Z)  <  lij4[ls,,„,(Z)  l!£||s,llB{Z)-  This  property  turns  5^(2)  into  an  interesting  mathematical 
object  so  called  g-Banach  algebra  for  0  <  q  <  1  and  Banach  algebra  for  1  <  q  <  oo  that  is  closed 
under  addition  and  multiplication  operations  for  all  0  <  q  <  oo,  i.e„  if  A,  D  belong  to  Sq,w(Z)y  then 
A  +  B  E  Sq^[X)  and  AB  E  StliW(X).  One  of  the  fundamental  properties  of  the  class  of  spatially 
decaying  matrices  Sq>w{Z)  is  that  it  is  inverse-closed  in  Z))  (the  Hilbert  space  of  all  bounded  matrices 
on  i.e.,  if  for  every  A  E  SqiW(X)  that  is  invertible  on  f2(2))?  we  have  that  A  1  E  SqiW(Z)  [27]. 

Definition  6  For  a  fixed  0  <  q  <  oo,  a  linear  system  ( 1 1 )-( 12)  is  called  spatially  decaying  on  Z  with  respect 
to  an  admissible  coupling  weight  function  w  if  its  state-space  matrices  A,  B,C,D  belong  to  Sq^(  Z). 

The  class  of  spatially  decaying  linear  systems  is  closed  under  basic  system  operations  such  as  series, 
parallel,  and  feedback  interconnections. 

Inherent  sparse  information  structure  of  linear-quadratic  regulators  (LQR),  In  our  first  major  result, 
we  consider  the  class  of  spatially  decaying  linear  systems  defined  over  Sq^w( Z)  for  0  <  q  <  oo  (Definition 
6).  One  of  the  fundamental  problems  in  the  context  of  spatially  distributed  systems  is  to  investigate  structural 
properties  of  the  linear-quadratic  regulator  (LQR)  problem  for  spatially  decaying  system  (1 1/(12)  with  cost 
functional 

roo 

J{ipQ,u)  =  /  (ip*Qip  +  u*Ru)  dt*  (15) 

Jq 

Suppose  that  weight  matrices  Q  and  /?  arc  self-adjoint  and  positive  definite  and  (A,  B)  is  exponentially 
stabilizable  and  (Q?  yl)  is  exponentially  detectable  in  B(£2(Z))  (the  Hilbert  space  of  all  bounded  matrices 
on  ^2(Z)).  The  LQR  feedback  control  law  is  given  by  u  —  -Kij)  —  —R~lB*X^  where  X  is  the  unique 
positive-definite  solution  of  the  algebraic  Riccati  equation 

A*X  +  XA-XBIT1B*X  +  Q  =  0,  (16) 
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The  spatial  decay  properties  of  the  quadralically  optimal  controllers  and  filtering  problems  for  spatially 
decaying  systems  are  closely  related  to  the  algebraic  properties  of  the  corresponding  algebraic  Riccati  equa¬ 
tions,  We  have  the  following  fundamental  result  for  the  class  of  spatially  decaying  systems  with  bounded 
operators. 


Theorem  I  { [27])  For  a  fixed  exponent  0  <  q  <  oo,  suppose  that  A,  B,  Q ,  R  belong  to  Sq^(  Z).  Then  the 
unique  positive-definite  solution  of  the  algebraic  Riccati  equation  (16)  also  belongs  to  SqjW(Z).  Further¬ 
more,  the  closed-loop  matrix  A  —  R~l  B*  X  generates  exponentially  stable  semigroup  on  SqAV(Z). 


The  outcome  of  Theorem  1  states  that  the  LQR  feedback  control  law  K  =  (Kij)j  -r  7  is  spatially 
localized,  Le„ 

\Ki}\  <  Cow(i-jy 1  (17) 

where  Cb  =  ||A’ qg)  is  a  finite  number.  This  implies  that  the  underlying  information  structure  of  the 
optimal  control  law  is  sparse  in  space  and  each  local  controller  needs  to  receive  information  only  from 
some  neighboring  subsystems  (and  not  from  the  entire  spatially  distributed  system).  The  implications  of  our 
results  for  spatially  decaying  systems  lay  foundations  of  a  genera!  theory  to  discover  fundamental  limits  of 
feedback  control  strategies  in  spatially  distributed  systems  due  to  sparse  information  structures. 

Fundamental  limits  on  best  achievable  degrees  of  spatial  localization.  In  order  to  characterize  a  funda- 
mental  limits  on  interplay  between  stability  margins  and  optimal  performance  loss  in  spatially  distributed 
systems,  we  approximate  the  corresponding  LQR  feedback  gain  K  by  a  sparse  feedback  gain  i£^-nearest  for 
a  given  truncation  length  T  >  0  as  follows 


(K%- nearest',  f  Kij  if 

\  0  if  \i  —  j\  >  T 


(18) 


By  applying  small-gain  theorem,  we  can  characterize  a  fundamental  limit  in  the  form  of  a  lower  bound 
for  stabilizing  truncation  lengths  for  different  admissible  coupling  weight  functions  [27].  For  the  subexpo¬ 
nential  coupling  weight  function  with  parameters  a  >  0  and  0  <  ft  <  L  the  sparse  feedback  controller 
nearest  j$  exponentially  stabilizing  if  the  truncation  length  T  satisfies  the  following  inequality 

s  >  xs  =  (-  log(||Jr|Ufl.W  t|B||em)  sup  <r,*x(G(a))))\  (19) 

\a  V  Re(s)>Q  7  / 

where  G(s)  =  (si  —  (A  +  Bli  ))“1  is  the  transfer  function  of  the  closed -loop  system.  A  fundamental 
tradeoff  emerges  between  truncation  length  and  performance  loss.  We  define  the  performance  loss  as  the 
expected  value  of  the  quantity  |  J(#0i  Kx)— I_nearesl^))|  overall  random  Gaussian  initial  conditions 
with  zero  mean  and  identity  covariance  matrix.  Our  results  show  that  the  performance  loss  asymptotically 
converges  to  zero  as  T  — >  oo  [27], 

Fundamental  tradeoffs  between  sparsity  and  spatial  local ity.  Let  us  consider  an  ideal  sparsity  measure 
whose  value  returns  the  maximum  number  of  nonzero  entries  in  all  rows  and  columns  of  a  matrix,  he., 


11^ ll$u(Z)  :=  max  {  sup  \\K(i,  .)|UZ),  sup  ||Jf(.,  j)[|fo(z)|, 
1  i$Z  jeZ  > 


where  K(i, .)  is  the  fth  row  and  the  j’th  column  of  matrix  K.  The  (°(Z)  quasi-norm  of  a  vector  is 

the  cardinality  of  the  set  of  its  nonzero  entries.  The  £(^1 -measure  (i.e.,  the  value  of  || . ||^0 , )  is  specifically 
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Promotes  sparsity  Promotes  spatial  localization 


I 

<Sb,i(G) 


Figure  2:  For  1  <  q  <  ooT  $qjW(Z)  is  a  Banach  algebra.  However,  SqtW (Z)  for  0  <  q  <  1  is  a  quasi-Banach  algebra. 
The  analysis  of  spatially  distributed  systems  which  are  defined  over  g-Banach  algebras  for  0  <  q  <  1  are  much  more 
subtle  than  those  systems  that  are  defined  over  Banach  algebras. 


tailored  for  spatially  distributed  systems  as  it  is  a  suitable  measure  for  sparsity  and  spatial  localization  simul¬ 
taneously,  The  ^-measure  (i.e,,  the  value  of  || .  ||$  (zy)  of  a  matrix  can  be  considered  as  an  asymptotic 
approximation  of  its  <Soti -measure,  since  the  following  limit  holds 


lim 


\\m 


„(Z)  =  Pdk.i{2)> 


(20) 


for  all  spatially  decaying  matrices  with  bounded  entries.  This  implies  that  the  class  of  spatially  decaying 
matrices  5g>U)(Z)  for  0  <  q  <  1  are  sparse  and  enjoy  certain  interesting  diagonal  decay  properties. 

An  important  fundamental  tradeoff  emerges  when  exponent  q  varies  from  zero  to  infinity.  On  one 
hand,  when  q  tends  to  large  numbers  and  gets  closer  to  oo,  the  -measure  asymptotically  approximates 
Soo,™ -measure  and  becomes  an  ideal  spatial  locality  measure.  On  the  other  hand,  when  q  tends  to  small 
numbers  and  gets  closer  to  zero,  the  5gtW-measure  asymptotically  approximates  5o,i -measure  and  becomes 
an  ideal  sparsity  measure.  We  prove  that  there  exists  an  exponent  q*  <  1  such  that  the  59!tu(2)-measure 
approximates  the  ideal  sparsity  measure  5o,i  in  probability  for  all  0  <  q  <  q*.  In  order  to  present  an  explicit 
and  sensible  result,  we  focus  on  the  class  of  exponentially  decaying  random  matrices  of  the  form 


7^(Z)= 


ijez 


U(-l,l) 


for  some  given  parameters  a  >  0  and  <5  €  (0, 1).  The  coefficients  i\j  are  drawn  from  the  continuous 
uniform  distribution  U(— 1, 1).  Fora  given  truncation  threshold  0  <  e  <  1,  the  sparsity  indicator  function 
for  a  random  subexponential ly  decaying  matrix  K  6  T^jfZ)  is  defined  by 


'I'/f.u.U,  e) 


mi 


2  [os/hie-*]  +  1 


(21) 


where  [_.J  is  the  floor  function.  For  proper  values  of  exponent  q  and  parameters  in  the  coupling  weight 
function  uk  the  sparsity  indicator  function  can  take  values  sufficiently  close  to  one.  This  implies  that  ma¬ 
trix  K  e  can  be  approximated  by  a  sparse  matrix  whose  StM-measure  is  close  to  ||Jsf||^  in 

probability. 


Theorem  2  ( [27])  Consider  the  class  of  matrices  and  the  subexponential  coupling  weight  function 

w/  with  parameters  af  =  -  for  some  5  £  (0, 1  )for  some  r}  G  (0, 1).  Let  us  define  parameter  0  =  glne^1. 
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Then,  for  every  K  6  we  have 


(22) 


“V|  <  eO  }  =  lj 

/br  evtf/7  eo  >  0.,  where  Y  :=  /0°°  e“(1“^)^dt 

The  result  of  this  theorem  provides  an  algorithm  to  approximate  the  LQR  feedback  gain  K  with  a  near- 
optimal  sparse  matrix.  Since  a  and  5  are  known,  we  can  pick  the  positive  parameters  r;  and  0  such  that 
7'  1,  for  example,  7'  =  0.95,  If  we  fix  parameter  0,  the  sparsity  indicator  function  becomes  a  single 

variable  function  of  exponent  q  and  its  value  can  be  calculated  for  range  of  parameters  0  <  q  <  L  Then, 
one  can  calculate  an  exponent  q*  such  that  the  value  of  the  sparsity  indicator  function  stays  arbitrarily 
close  to  7'  for  all  0  <  q  <  q*.  The  number  ||If||^  represents  an  optimal  tradeoff  between  sparsity 
and  spatial  localization  measures.  Furthermore,  we  can  extract  more  information  from  exponent  q*  and 
compute  an  optimal  truncation  length  using  the  formula  To  =  ^  By  combining  this  result  with  (19),  a 
near-optimal  stabilizing  truncation  length  for  the  LQR  feedback  gain  is  given  by 

Top  =  max  {To,  Ts}.  (23) 

Mathematical  foundation  of  notions  of  sparsity  in  spatially  decaying  systems.  The  notion  of  sparsity 
in  spatially  decaying  systems  can  be  generalized  to  more  abstract  ground  via  quasi-Banach  algebras,  which 
is  a  complex  vector  space  of  matrices  A  on  Z  equipped  with  q- norm  ||  -  for  0  <  q  <  L  The  quasi- 
Banach  algebras  enjoy  similar  basic  properties  to  Sq<w{ Z),  e.g.,  it  is  closed  under  addition  and  multiplication 
operations. 

Definition  7  {  [27])  For  0  <  q  <  1.  a  q-Banach  algebra  A  of  matrices  equipped  with  q-norm  ||  ■  is 
called  proper  if  it  is;  (i)  closed  under  the  complex  conjugate  operation,  (ii)  a  subalgebra  Z))  and 

continuously  embedded  with  respect  to  it,  and  (Hi)  a  differential  Banach  subalgebra  ofB{£2( Z)). 

Our  results  show  that  a  proper  ^-Banach  algebra  is  inverse-closed.  This  enable  us  to  define  the  class  of 
linear  systems  over  proper  g-Ranach  algebra  and  study  their  exponential  stability.  Moreover,  we  prove  that, 
under  standard  assumptions,  if  the  coefficients  of  the  algebraic  Riccati  equation  belong  to  a  proper  ty-Banach 
algebra  A ,  then  X  €  A. 

2 A  Interplay  Between  Spatial  Localization  Measures  and  Systemic  Measures 

In  our  research  results  [26],  we  show  that  for  the  class  of  linear  consensus  networks  (I  M2)  with  n  >  3,  the 
following  fundamental  limit  emerges  between  the  ideal  sparsity  measure  and  zeta  function  based  systemic 
measures 

v  —  1 

,  (24) 

where  Ag  is  the  adjacency  matrix  of  the  underlying  unweighted  graph  of  the  network.  For  networks  with 
identical  number  of  nodes,  this  fundamental  tradeoff  asserts  that  by  improving  local  connectivity  in  a  net¬ 
work  the  minimum  (best)  achievable  level  of  the  systemic  measure  decreases. 

The  PI  believes  that  theses  results  can  be  extended  to  quantify  fundamental  tradeoffs  between  systemic 
measures  and  the  class  of  Sq^  -measures  for  sparsity  and  spatial  localization.  This  is  extremely  important 
as  it  will  reveal  several  key  network  design  principles  and  show  the  effects  of  spatial  localization  on  global 
performance  and  robustness  of  spatially  distributed  dynamical  networks.  This  objective  is  particularly  chal¬ 
lenging  as  the  class  of  5^ -measures  for  0  <  q  <  I  are  nonconvex  matrix  norms  and  require  us  to  develop 
our  framework  based  on  tools  from  quasi -Banach  algebras. 
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3  Network  Sparsification  with  Guaranteed  Systemic  Performance  Measures 


A  sparse  consensus  network  is  one  whose  number  of  coupling  links  is  proportional  to  its  number  of  sub¬ 
systems,  Optimal  design  problems  for  sparse  consensus  networks  are  more  amenable  to  efficient  optimiza¬ 
tion  algorithms.  More  importantly,  maintaining  such  networks  are  usually  more  cost  effective  due  to  their 
reduced  communication  requirements.  Therefore,  approximating  a  given  dense  consensus  network  by  a 
suitable  sparse  network  is  an  important  analysis  and  synthesis  problem.  In  this  chapter,  we  develop  a  frame¬ 
work  to  produce  a  sparse  approximation  of  a  given  large-scale  network  with  guaranteed  performance  bounds 
using  a  nearly-linear  time  algorithm.  First,  the  existence  of  a  sparse  approximation  of  a  given  network  is 
proven.  Then,  we  present  an  efficient  and  fast  algorithm  for  finding  a  near-optimal  sparse  approximation  of 
a  given  network.  Finally,  several  examples  are  provided  to  support  our  theoretical  developments. 

In  [8,35],  we  specifically  addressed  the  following  network  design  problem:  given  a  linear  consensus 
network  with  an  undirected  connected  underlying  graph,  the  network  sparsification  problem  seeks  to  re¬ 
place  the  coupling  graph  of  the  original  network  with  a  reasonably  sparser  subgraph  so  that  the  behavior  of 
the  original  and  the  sparsified  networks  is  similar  in  an  appropriately  defined  sense.  Such  situations  arise 
frequently  when  real-world  large-scale  dynamical  networks  need  to  be  simulated,  controlled  or  redesigned 
using  efficient  computational  tools  that  are  specifically  tailored  for  optimization  problems  with  sparse  struc¬ 
tures.  We  develop  a  general  methodology  that  computes  spars! tiers  of  a  given  consensus  network  using  a 
nearly-linear  time  O(m)1  algorithm  with  guaranteed  systemic  performance  bounds,  where  m  is  the  number 
of  links.  Unlike  other  existing  work  on  this  topic  in  the  literature,  our  proposed  framework:  (i)  works  for 
a  broad  class  of  systemic  performance  measures  including  ^2-based  performance  measures,  (ii)  does  not 
involve  any  sort  of  relaxations  such  as  to  t\,  (iii)  provides  guarantees  for  the  existence  of  a  sparse  solu¬ 
tion,  (iv)  can  partially  sparsify  predetermined  portions  of  a  given  network;  and  most  importantly,  (v)  gives 
guaranteed  systemic  performance  certificates. 

While  our  approach  is  relied  on  several  existing  works  in  algebraic  graph  theory,  our  control  theoretic 
contributions  are  threefold.  First,  we  show  that  every  given  linear  consensus  network  has  a  sparsifier  net¬ 
work  such  that  the  two  networks  yield  comparable  performances  with  respect  to  any  systemic  performance 
measure.  Second,  we  develop  a  framework  to  find  a  sparse  approximation  of  large-scale  consensus  net¬ 
works  using  a  fast  randomized  algorithm.  We  note  that  while  the  coupling  graph  of  the  sparsified  network  is 
a  subset  of  the  coupling  graph  of  the  original  network,  the  weights  of  links  (the  strength  of  each  coupling) 
in  the  sparsified  network  are  adjusted  accordingly  to  reach  predetermined  levels  of  systemic  performance. 
Third,  we  prove  that  our  development  can  also  be  applied  for  partial  sparsification  of  large-scale  networks, 
which  means  that  we  can  sparsify  a  prespecified  subgraph  of  the  original  network  to  find  an  approximation 
of  the  network  with  fewer  links.  This  is  practically  plausible  as  our  algorithm  can  be  spatially  localized,  if 
necessary,  and  it  does  not  require  to  receive  information  of  the  entire  coupling  graph  of  the  network. 

We  develop  a  sparsification  framework  for  the  class  of  linear  consensus  networks  governed  by  ( !)- 
(2)  that  provides  performance  guarantees  with  respect  to  a  general  class  of  systemic  measures.  First,  we 
introduce  a  notion  of  approximation  for  the  class  of  consensus  networks. 

Definition  8  For  a  fixed  constant  e  £  [0,  l],  a  consensus  network  fif(Ls)  is  c- approximation  offif(L)  if  and 
only  if 

(1  -<0“  <  ^  (1  +  £)“  (25) 

for  every  homogenous  convex  systemic  measure  p  :  £n  R+  of  order  a  >  0. 

1  We  use  Q{.)  to  hide  poly  log  log  terms  from  the  asymptotic  bounds.  Thus,  f(n)  6  C9(g(7t))  means  that  there  exists  k  >  0 
such  that  f(n)  £  O  (g(n)  logfe  g(n))  ■ 
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Lemma  1  J\f{Ls)  is  an  c -approximation  if  and  only  if  the  following  inequalities  hold 


(1  -c)L  *  Ls  !  (1  +  e)L.  (26) 

This  result  is  fundamental  as  it  enables  us  to  take  advantage  of  monotonicity  property  of  systemic  mea¬ 
sures  in  our  approximations. 

Existence  of  6- Approximations:  Among  all  ^-approximation  of  a  given  consensus  network  with  a  dense 
coupling  graph,  we  are  interested  in  its  sparsifiers,  i.e.,  those  networks  with  sparse  coupling  graphs. 

Definition  9  Jf(Ls)  is  a  (cy  d) -sparsifier  of  a  given  network  fif  (L)  with  n  nodes  if  the  following  conditions 
hold: 

l  M{Ls)  is  an  e-approximation  of  network  JSf  (L);  and 

2.  the  coupling  graph  of  Af  Ls)  has  at  most  dnf  2  links  (Le„  feedback  gains). 

The  second  condition  implies  that  the  average  number  of  connected  links  to  nodes  in  the  sparsifier  is  at 
most  d.  In  the  following  theorem,  we  show  existence  of  sparsifiers  for  every  given  consensus  network. 


Theorem  3  Suppose  that  a  consensus  network  A f(L)  with  coupling  graph  Q  —  (V,  £1w)  and  d  >  1  are 
given.  Then ,  there  exists  a  consensus  network  Jf(L$)  with  coupling  graph  Gs  =  ( V,  £S)  ws)  such  that 
jV(Ls)  is  a  .  2d)-sparsifier  of  Ai  (L)  and  £$  C  £. 

Specifically,  Theorem  3  shows  that  every  given  linear  consensus  network  with  dynamics  ( 1>(2)  has  a 
sparse  consensus  network  such  that  the  two  networks  yield  comparable  performances  with  respect  to  any 
systemic  performance  measure  p  :  £n  — ¥  R+. 

In  our  next  result,  we  show  that  every  consensus  network  has  a  sparse  consensus  network  such  that:  (i)  it 
yields  a  better  systemic  performance  than  the  original  network,  and  (ii)  the  total  weight  sum  of  the  coupling 
graph  of  the  sparsifier  is  controlled,  i.e.,  it  is  less  than  a  constant  multiplier  of  that  of  the  original  network. 
For  a  given  coupling  graph  with  Laplacian  matrix  L  and  the  set  of  links  £ ,  we  denote  the  total  weight  sum 
of  the  coupling  graph  by 

^iomi(^)  :=  y~V(e).  (27) 


Theorem  4  For  a  given  consensus  network  Af{L)  with  coupling  graph  Q  —  ( V .  £ ,  w )  and  ever}'  d  >  1, 
there  exists  a  consensus  network  Af{Ls)  with  coupling  graph  Qs  —  (V,  ws )  that  has  at  most  dn  links  and 
£s  C  £.  Moreover,  we  have 


Wtotal{Ls)  < 


(dill 

(  yfd  -  1 


2 


w  total  {O) 


(28) 


and 

P(LS)  <  p{L), 


for  every  convex  systemic  measure  p  :  £n  —¥  R+. 


We  note  that  linear  consensus  networks  with  smaller  systemic  performance  measure  are  more  desirable 
and  they  exhibit  better  network-wide  performance. 

Computing  Sparsifiers  via  Random  Sampling:  We  employ  a  randomized  algorithm  to  compute  a  (e>  d)- 
sparsifier  of  a  given  network.  A  randomized  algorithm  employs  a  degree  of  randomness  as  part  of  its 
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logic.  Randomization  allows  us  to  design  provably  accurate  algorithms  for  problems  that  are  massive  and 
computationally  expensive  or  NP-hard.  According  to  our  discussions  in  [8,35],  we  sample  low-connectivity 
coupling  links  with  high  probability  and  high-connectivity  coupling  links  with  low  probability.  For  a  given 
consensus  network  J\f(L)  w  ith  n  nodes,  we  sample  links  of  the  coupling  graph  of  this  network  M  times  in 
order  to  produce  a  (e,2M/n)-sparsifier  of  it.  Let  us  denote  probability  of  selecting  a  link  e  €  £  by  7r(e) 
that  is  proportional  to  iu(e)r(e),  where  w(e)  and  ?'(e)  are  the  weight  and  the  effective  resistance  of  link 
e,  respectively.  In  each  step  of  sampling,  we  add  the  selected  link  e  to  the  sparsifier  network  with  weight 
r(e)).  All  details  of  this  algorithm  is  explained  below: 

Table  1 :  Network  Sparsification  Algorithm 

Algorithm: 

Input:  Q  ~  (V\£,  w) 

1 :  set  Qx  to  be  the  empty  graph  on  V 

2:  fori  — 1  to  M 

3:  sample  link  e  G  £  with  probability  7r(e) 

add  it  to  Qs  with  link  weight  7r(e)) 

4:  endfor 


The  following  theorem  provides  us  with  a  proof  certificate  that  the  above  randomized  algorithm  is  capa¬ 
ble  of  generating  a  sparse  approximation  of  a  given  consensus  network. 

Theorem  5  For  a  given  consensus  network  Af(L)t  a  fixed  constant  e  G  1]  and  an  integer  number 

M  =  0{n  log  n  ft2).  Network  Sparsification  Algorithm  produces  a  (e?  2M fuf  sparsifier  of  network  N{L) 
with  high  probability2. 

Network  Sparsification  Algorithm  produces  a  sparsifier  with  with  C?(nlogn/e2)  links  (Le„  feedback 
gains)  in  expectation  and  runs  in  approximately  linear  time  O(m),  where  m  is  the  number  of  links  [8,35].  To 
do  so,  good  approximations  of  all  effective  resistances  are  needed,  and  Spielman  and  Srivastava  prove  that 
C?(log  n)  calls  to  a  solver  for  symmetric  diagonally  dominant  (SDD)  linear  systems  can  provide  sufficiently 
good  approximations  to  all  effective  resistances, 

4  Performance  and  Robustness  Measure  for  Time-Delay  Networks 

In  [1 1],  we  investigate  performance  of  noisy  time-delayed  linear  consensus  networks  from  a  graph  topologi¬ 
cal  point  of  view.  Performance  of  the  network  is  measured  by  the  square  of  the  T^-norm  of  the  system.  The 
focus  of  this  work  is  on  noisy  consensus  networks  with  homogeneous  time  delays  affecting  both  the  agent 
and  all  its  neighbors.  We  derive  an  exact  expression  for  the  performance  measure  of  the  network  in  terms 
of  time  delay  parameter  and  Laplacian  eigenvalues  of  the  underlying  graph  of  the  network.  It  is  shown  that 
the  performance  measure  is  a  convex  and  Schur-convex  function  of  Laplacian  eigenvalues.  We  characterize 
the  network  topology  with  optimal  performance.  Furthermore,  we  quantify  a  fundamental  limit  on  the  best 
achievable  performance  based  on  performance  of  the  optimal  topology. 

In  [17],  we  investigate  topology  design  for  optimal  performance  in  time-delay  noisy  networks.  Perfor¬ 
mance  of  the  network  is  measured  by  the  square  of  the  system's  Tfs-norm.  Our  focus  was  on  adding  new 

2 An  event  holds  with  high  probability  iF  it  holds  with  probability  1  -  0(n  ")  for  some  a  >  0  independent  of  n. 
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interconnections  to  enhance  performance  of  the  time-delay  first-order  connected  consensus  network.  We  dis¬ 
cuss  complexity  of  topology  optimization  for  delayed  networks  and  develop  two  practical  methods  to  tackle 
the  combinatorial  eigenvalue  problem  without  exhaustive  search  or  eigen-decomposition.  Furthermore,  we 
compare  these  methods  and  discuss  their  degrees  of  optimality.  In  [32],  we  provide  a  comprehensive  anal¬ 
ysis  on  the  effect  of  time-delay  that  reincarnates  itself  in  the  form  of  non-monotonicity,  which  results  in 
non  intuitive  behaviors  of  the  performance  as  a  function  of  graph  topology.  We  present  three  methods  to 
improve  the  performance  by  growing,  re-weighting,  or  sparsifying  the  underlying  graph  of  the  network.  It 
is  shown  that  our  proposed  algorithms  provide  near-optimal  solutions  with  lower  complexity  with  respect  to 
existing  methods  in  literature. 

In  [15],  we  extend  our  focus  and  consider  time-delay  nonlinear  consensus  networks.  We  investigate 
stability  and  convergence  properties  of  a  class  of  nonlinear  delayed  consensus  networks.  Using  tools  and 
techniques  from  functional  differential  equations,  sufficient  stability  conditions  with  respect  to  a  common 
state  as  well  as  estimates  on  the  convergence  rate  are  derived.  We  characterize  the  limit  (consensus)  state  for 
time- invariant  sub-classes  of  these  networks.  More  importantly,  we  specify  under  what  conditions  a  delayed 
network  exhibits  periodic  synchronized  solutions.  We  provide  sufficient  conditions  for  existence,  uniqueness 
and  stability  of  this  interesting  phenomenon.  There  are  several  important  open  problems  remaining  from 
this  effort. 


5  Design  of  Sparse  Feedback  Controllers  for  Spatially  Distributed  Systems 

In  the  following  efforts,  we  implemented  our  theoretical  findings  to  compute  sparse  feedback  controllers 
using  existing  optimization  algorithms, 

5.1  Closed-Loop  Feedback  Sparsification  Under  Parametric  Uncertainties 

In  [191,  we  consider  the  problem  of  output  feedback  controller  sparsification  for  systems  with  parametric 
uncertainties.  Wc  develop  an  optimization  scheme  that  minimizes  the  performance  deterioration  from  that 
of  a  well-performing  pre-designed  centralized  controller,  while  enhancing  sparsity  pattern  of  the  feedback 
gain.  In  order  to  improve  temporal  proximity  of  the  pre-designed  control  system  and  its  sparsified  counter¬ 
part,  we  also  incorporate  an  additional  constraint  into  the  problem  formulation  such  that  the  output  of  the 
controlled  system  is  enforced  to  stay  in  the  vicinity  of  the  output  of  the  pre-designed  system.  It  is  shown 
that  the  resulting  non-convex  optimization  problem  can  be  equivalently  reformulated  into  a  rank-constrained 
problem.  We  then  formulate  a  bi-linear  minimization  problem  to  obtain  a  sub-optimal  solution  which  satis¬ 
fies  the  rank  constraint  with  arbitrary  tolerance.  Finally,  a  sub-optimal  sparse  controller  synthesis  for  l FEE 
39-bus  New  England  power  network  is  used  to  showcase  the  effectiveness  of  our  proposed  method. 

5.2  Output  Feedback  Controller  Sparsification  via  ^-Approximation 

In  [9],  we  investigate  the  problem  of  optimal  sparse  output  feedback  control  design  for  continuous  linear 
time  invariant  systems.  Unlike  previously  proposed  methods  where  linear  quadratic  regulator  control  is 
modified  to  promote  the  sparsity  level  of  the  controller  gain  matrix,  this  research  adopts  the  concept  of 
Wy/Ho o  control  to  develop  an  optimization  program  capable  of  synthesizing  a  structured  sparse  static  con¬ 
troller  gain  for  which  the  overall  dosed  loop  system  exhibits  empirical  frequency  characteristics  resembling 
that  of  the  system  controlled  with  a  pre-designed  centralized  controller.  We,  moreover,  modified  our  opti¬ 
mization  problem  so  that  the  control  signal  generated  by  the  sparse  controller  falls  into  the  vicinity  of  the 
centralized  control  input,  in  the  sense  of  £2^norm.  Furthermore,  we  show  that  our  optimization  problem  can 
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be  equivalently  reformulated  into  a  rank  constrained  problem  for  which  we  propose  to  use  a  version  of  Alter¬ 
nating  Direction  Method  of  Multipliers  (ADMM)  as  a  computationally  efficient  algorithm  to  sub-optimal ly 
solve  it.  There  are  several  renaming  issues  to  address  regarding  complexity  of  existing  optimization  tools. 

6  Systemic  Performance  Measures  for  Nonlinear  Dynamical  Networks 

6*1  Koopman  Performance  Analysis  of  a  Class  of  Nonlinear  Dynamical  Networks 

In  this  research  effort,  we  aimed  at  extending  some  of  our  systemic  measures  results  to  nonlinear  dynamical 
networks.  In  [21],  we  have  been  able  to  utilize  Koopman  operator  machinery  to  calculate  a  performance 
measures  of  a  class  of  networks  with  nonlinear  nodal  dynamics.  Let  us  consider  the  following  Cucker-Smale 
type  nonlinear  network 

x  —  —  L(x)x.  (29) 

The  elements  of  the  state-dependent  Laplacian  matrix  L(x)  =  [%(^)]  are  a  nonlinear  function  of  distance 
between  the  agents*  i.e., 

kj{x)  =  f(\\2i  -  Zjll). 

The  output  or  observable  of  the  network  is 

y{t)  =  x(t. )  -  lx{t), 

where  1  is  the  vector  of  all  ones  and  x(£)  is  the  average  of  all  states  at  time  t  >  0.  Suppose  that  dynamical 
network  (29)  is  in  its  equilibrium  state*  i.e.*  all  agents  have  agreed  upon  a  consensus  state  x*  =  al  for  some 
constant  a.  If  we  twitch  the  network  by  abruptly  changing  the  state  of  the  system  to  a  random  state  (i.e., 
network  (29)  with  a  random  initial  condition),  the  required  mean  output  energy  to  steer  the  network  to  its 
equilibrium  (i.e,,  nominal  form)  is  given  by  quantity 

pss(L)  =  E  1 1  yT(r)y(r)cir| .  (30) 

We  have  developed  a  methodology  for  quantifying  this  performance  measure  in  terms  of  the  Koopman 
eigenfunctions  of  the  nonlinear  network*  and  the  eigenvalues  of  the  corresponding  linearized  system  at  the 
equilibrium  of  the  network,  where  the  eigenvalues  of  the  linearized  system  are  indeed  Laplacian  eigenvalues 
of  the  underlying  graph  with  opposite  signs.  More  precisely,  we  have 

OQ 

Pss(L)  =  -  ^  ^  ^  ^  4>ij  (31) 

ij= 2  1  3 

where  {  is  the  sequence  of  Koopman  eigenvalues,  j  is  the  sequence  of  Koopman  eigenfunc¬ 
tions*  and  is  the  sequence  of  Koopman  modes.  We  show  that  Ai  =  0  and  A:  <  0  for  all  i  >  1  for 

connected  coupling  graphs.  Our  results  reveal  that  the  performance  measure  ps${L)  depends  on  the  inter¬ 
connection  topology  of  the  underlying  graph.  The  reason  is  that  Koopman  eigenvalues  can  be  represented 
in  terms  of  Laplacian  eigenvalues  of  the  underlying  graph.  The  effectiveness  of  our  results  are  shown  on 
several  benchmark  examples,  including  a  Cucker-Smale  type  consensus  network  and  first-order  network  of 
identical  Kuramoto  oscillators.  Furthermore,  as  it  is  shown  in  Figure  4  of  our  paper  [21],  nonlinear  networks 
with  more  dense  coupling  topology  tend  to  have  better  performance  features.  We  have  gained  some  valu¬ 
able  insights  from  these  results  and  identified  potential  difficulties  of  dealing  with  nonlinear  networks.  We 
believe  that  our  operator  theoretic  approach  along  with  advanced  graph  theory  and  some  scalable  approxi¬ 
mation  schemes  will  enable  us  to  solve  performance  and  robustness  analysis  of  nonlinear  networks. 
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6-2  Fundamental  Limits  on  Performance  of  Autocataly tic  Pathways 


I  briefly  outline  the  basics  of  our  method  to  analyze  autocatalytic  dynamical  networks  |?,?,34],  We  will 
consider  three  scenarios.  First,  a  minimal  model  of  an  autocatalytic  system  is  analyzed.  Then,  a  more 
general  network  topology  with  multiple  intermediate  metabolite  reactions  is  considered.  Third,  we  propose 
a  general  model  for  autocatalytic  networks  using  graph  theory  tools.  Finally,  we  propose  a  novel  approach 
to  characterize  hard  limits  in  interconnected  networks  of  dynamical  systems  using  duality  concepts.  The 
first  step  is  development  of  a  biologically  motivated  minimal  model  of  autocatalytic  dynamical  networks 
that  exhibits  fundamental  tradeoffs  caused  by  autoeatalysis,  Analysis  of  robustness  and  efficiency  tradeoffs 
for  such  canonical  model  provides  a  deep  understanding  of  structural  properties  of  autocatalytic  networks  as 
well  as  illustrates  theoretical  underpinning  principles  to  design  efficient  and  robust  networks  of  dynamical 
systems. 

Minimal  model  of  glycolysis.  The  central  role  of  glycolysis  is  to  consume  glucose  and  produce  adenosine 
triphosphate  (ATP),  the  cells  energy  currency.  Similar  to  many  other  engineered  systems  whose  machinery 
runs  on  its  own  energy  product,  the  glycolysis  reaction  is  autocatalytic.  The  ATP  molecule  contains  three 
phosphate  groups  and  energy  is  stored  in  the  bonds  between  these  phosphate  groups.  Two  molecules  of 
ATP  are  consumed  in  the  early  steps  (hexokmase,  phosphofructokinase/PFK)  and  four  ATPs  are  generated 
as  pyruvate  is  produced.  PFK  is  also  regulated  such  that  it  is  activated  when  the  adenosine  monophosphate 
(  AMP)/ ATP  ratio  is  low;  hence  it  is  inhibited  by  high  cellular  ATP  concentration.  This  pattern  of  product 
inhibition  is  common  in  metabolic  pathways. 

Early  experimental  observations  in  Saccharomyces  cerevisiae  suggest  that  there  are  two  synchronized 
pools  of  oscillating  metabolites.  Metabolites  upstream  and  downstream  of  phosphofructo  kinase  (PFK)  have 
180  degrees  phase  difference,  suggesting  that  a  two-dimensional  model  incorporating  PFK  dynamics  might 
capture  some  aspects  of  system  dynamics,  and  indeed,  such  simplified  models  qualitatively  reproduce  the  ex¬ 
perimental  behavior.  We  consider  a  minimal  system  with  three  reactions  with  a  single  intermediate  metabo¬ 
lite  reaction  (32)-(34),  for  which  we  can  identify  specific  mechanisms  both  necessary  and  sufficient  for 
oscillations, 

s  +  ay  — ^  xi  (32) 

-**■  (a+p)y  +  x  1  (33) 

y  0  (34) 

In  the  first  reaction,  s  is  some  precursor  and  source  of  energy  for  the  pathway  with  no  dynamics  associated, 

y  denotes  the  product  of  the  pathway  (ATP).  x\  is  intermediate  metabolites,  x[  is  one  of  the  by-products 
of  the  second  biochemical  reaction,  0  is  a  null  state,  a  is  the  number  of  y  molecules  that  are  invested  in 
the  pathway,  and  a  T  0  is  the  number  of  y  molecules  produced.  .4  — ^  B  denotes  a  chemical  reaction 
that  converts  the  chemical  species  A  to  the  chemical  species  B  at  rate  A:. We  choose  f(y)  =  \^yyh  *  which 
is  consistent  with  biological  intuition  and  experimental  data  in  the  case  of  the  glycolysis  pathway,  where 
V  >  0  depends  on  s,  parameter  q  >  0  captures  the  strength  of  autocatalysis,  and  7,  h  >  0  capture  the 
strength  of  inhibition.  The  function  /  is  not  monotone  and  captures  the  interplay  between  the  autocatalysis 
and  inhibition.  A  set  of  ordinary  differential  equations  that  govern  the  changes  in  concentrations  Xi  and  y 
can  be  written  as 


±1 


V 


-kxx\  + 


Vif 

1  +  7  yh 


-kyy  +  (a  +  /3)kXXl 


avy 

1  4-  7  yh  ’ 


(35) 

(36) 
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for  x\  >  0  and  y  >  0*  To  highlight  fundamental  tradeoffs  due  to  autocatalytic  structure  of  the  system,  we 
normalize  the  concentration  such  that  steady  states  are  y  =  1  and  x  =  -^7-. 

Depending  on  values  of  parameters  q  and  ht  the  system  can  have  another  equilibri  um  point  which  is 
unstable  when  (x,  y)  is  stable.  Our  model  (35)-(36)  is  a  general  version  of  model  proposed  by  Doyle  et. 
ah.  In  glycolysis  model  (35)-(36),  expression  can  be  interpreted  as  the  regulatory  feedback  control 

employed  by  nature  which  captures  inhibition  of  the  catalyzing  enzyme.  Hence,  we  can  derive  a  control 
system  model  for  glycolysis  as  follows 

x  —  -kxx-bVyqu  (37) 

y  «  —kyy  +  (a  +  0)kxx  -  aVyqu ,  (38) 

where  u  is  the  control  input.  Out  primary  motivation  behind  developing  and  analyzing  such  control  system 
models  for  metabolic  pathways  is  to  rigorously  prove  that  the  tradeoffs  in  such  models  are  truly  unavoidable 
and  independent  of  control  mechanisms  (linear  or  nonlinear)  used  to  regulate  such  pathways.  The  following 
results  assert  that  essential  tradeoffs  depend  only  on  autocatalytic  structure  of  the  network* 

Hard  limits  on  ideal  performance.  We  denote  by  y(t ;  u)  the  output  of  the  system  (37)-(38)  with  respect  to 
control  input  u.  For  all  possible  stabilizing  control  inputs  uq  E  L2([0,  do)),  i.e.f  \uo(t)\2dt  <  00,  we  can 
prove  that  there  is  a  hard  limit  on  the  best  achievable  ideal  performance  of  the  system  which  is  characterized 
as  the  following  inequality 

(y(t\u0)-y)2dt  >  H(x(Q),y(Q);a,P),  (39) 

in  which 

fl(s(0),t(0);M)=  {aj^~~jTj2  (40) 

and  z{ 0)  =  x(Q)  +  —  y{ 0)  and  z  =  x  +  ™  y-  We  define  rate  of  profit  p  as  the  ratio  of  /3  (net  production 
of  ATP  molecules)  to  a  (number  of  ATP  molecules  invested  in  the  pathway),  i.e.,  p  =  The  hard  limit 
function  (40)  can  be  rewritten  as 

fl(x(0),i,(0);Art  =  p(kp*kiy  (*(0)  ~  (41) 

Fundamental  tradeoff  between  fragility  and  net  production*  When  we  keep  the  rate  of  profit  p  fixed,  a 
fundamental  tradeoff  between  net  production  of  ATP  molecules  and  transient  behavior  of  the  system  emerges 
as  follows:  increasing  8  can  result  in  undesirable  transient  behavior  (e.g,,  large-magnitude  oscillation  in  the 
output  of  the  system)  and  can  increase  fragility  of  the  network  to  small  disturbances.  For  instance,  if  the 
level  of  ATP  drops  below  some  threshold,  there  will  not  be  sufficient  supply  of  ATP  for  different  pathways 
in  the  cell  and  that  can  result  to  cell  death. 

Elimination  of  hard  limits  by  rewiring  the  network*  We  consider  a  modified  model  of  glycolysis  pathway 
where  autocatalysis  and  regulating  control  feedbacks  are  applied  on  different  biochemical  reactions.  We 
assume  that  the  enzyme  PFK  is  not  regulated.  The  main  motivation  for  deriving  this  model  is  that  ATP 
also  inhibits  PK  activity  (the  second  biochemical  reaction).  This  is  a  simple  abstract  model  that  shows  how 
to  eliminate  hard  limits  in  autocatalytic  networks.  The  set  of  ordinary  differential  equations  governing  the 
changes  in  concentrations  x\  and  y  is  given  by 

x  =  —  kxx  u  +  Vyq 

—  —kyy  -f  (q  T  8)  kxx  u  —  aVyq. 
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(42) 

(43) 


where  u  is  the  control  input  We  assume  that  the  desired  equilibrium  point  is  still  (5:.  y)  in  order  for  a  fair 
comparison  between  the  two  models  and  their  corresponding  hard  limits.  We  can  prove  that  there  is  no  hard 
limit  on  the  i2-norm  of  the  output  production,  be., 

(y(t;  u0)  -  y }2  dt  =  0{t)  (44) 

for  all  stabilizing  state  feedback  control  laws  u§  for  system  (42)-{43)  with  no  €  L2([Q,og)),  The  notation 
0(e)  (the  big  O  of  r)  comes  from  solving  the  corresponding  cheap  optimal  control  problem.  The  inequality 
(44)  implies  that  the  value  of  integral  can  be  made  arbitrarily  small  using  cheap  optimal  controllers  [34]  and 
that  the  transient  stability  and  performance  of  the  system  can  be  improved  arbitrarily  with  no  hard  limit. 

6.3  Synchronization  and  Collision  Avoidance  in  Nonlinear  Dynamical  Networks  of  Agents 

In  [14],  we  introduce  and  discuss  two  novel  second-order  consensus  networks  with  state-dependent  cou¬ 
plings  of  Cucker-Smale  type.  The  first  scheme  models  flocking  to  synchronization  over  a  network  of  agents 
where  the  alignment  of  the  agent’s  states  occurs  over  a  non-trivial  limit  orbit  that  is  generated  by  the  internal 
dynamics  of  each  individual  agent.  The  second  scheme  models  the  speed  alignment  of  a  group  of  agents 
which  avoid  approaching  each  other  closer  than  a  prescribed  distance.  While  seemingly  different,  both  of 
these  systems  can  be  analyzed  using  the  same  mathematical  methods.  We  rigorously  analyze  both  examples 
and  reveal  their  striking  similarities.  We  arrive  at  sufficient  conditions  that  relate  the  initial  configurations 
and  the  systems’  parameters  that  give  rise  to  a  collective  common  behavior.  There  are  several  important  open 
problems  related  to  this  topic.  In  [16],  we  investigate  the  stability  of  a  class  of  nonlinear  flocking  schemes 
of  Cucker-Smale  type  executed  on  a  finite  population  of  autonomous  agents.  We  use  algebraic  graph  theory 
tools  and  derive  sufficient  conditions  for  asymptotic  convergence  for  velocity  coordination  while  the  flock 
remains  sufficiently  connected.  In  addition,  the  positions  of  the  agents  converge  to  some  predefined  relative 
distances. 

7  Centrality  Measures  in  Dynamical  Networks 

7.1  Notions  of  Centrality  in  Consensus  Protocols  with  Structured  Uncertainties 

In  this  research  thrust,  we  explored  how  we  can  utilize  notions  of  systemic  performance  measures  to  identify 
central  nodes  and  couplings  in  large-scale  networks  [22,30],  This  is  particularly  important  for  designing 
robust  dynamical  networks.  In  [22,30],  we  introduced  new  insights  into  the  network  centrality  based  not 
only  on  the  network  topology  but  also  on  the  network  dynamics.  The  focus  of  this  effort  was  on  the  class 
of  uncertain  linear  consensus  networks  in  continuous  time,  where  the  network  uncertainty  is  modeled  by 
structured  additive  Gaussian  white  noise  input  on  the  update  dynamics  of  each  agent.  The  performance  of 
the  network  is  measured  by  the  expected  dispersion  of  its  states  in  steady-state.  This  measure  is  equal  to 
the  square  of  the  T^-norm  of  the  network,  and  it  quantifies  the  extent  by  which  its  state  is  away  from  the 
consensus  state  in  steady-state.  We  show  that  this  performance  measure  can  be  explicitly  expressed  as  a 
function  of  the  Laplacian  matrix  of  the  network  and  the  covariance  matrix  of  the  noise  input.  We  investigate 
several  structures  for  the  noise  input  and  provide  engineering  insights  on  how  each  uncertainty  structure 
can  be  relevant  in  real-wrorld  settings.  Then,  a  new  centrality  index  is  defined  to  assess  the  influence  of 
each  agent  or  link  on  the  network  performance.  For  each  noise  structure,  the  value  of  the  centrality  index 
is  calculated  explicitly,  and  it  is  shown  that  how  it  depends  on  the  network  topology  as  well  as  the  noise 
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structure.  Our  results  assert  that  agents  or  links  can  be  ranked  according  to  this  centrality  index  and  their 
rank  can  drastically  change  from  the  lowest  to  the  highest,  or  vice  versa,  depending  on  the  noise  structure. 

7,2  Eminence  Grise  Coalitions:  On  the  Shaping  of  Public  Opinion 

in  this  effort,  we  characterize  another  aspect  of  notion  of  centrality  in  time-varying  linear  dynamical  net¬ 
works.  In  [6,  7,  22, 29],  we  have  considered  an  opinion  network  of  multiple  individuals  with  dynamics 
evolving  via  a  general  time-varying  continuous  time  consensus  algorithm.  In  such  a  network,  for  an  arbi¬ 
trary  fixed  initial  time,  a  subset  of  individuals  forms  an  eminence  grise  coalition  (EGC)  if  the  individuals  in 
that  subset  are  capable  of  leading  the  entire  network  to  agreeing  on  any  desired  opinion  through  a  coopera¬ 
tive  choice  of  their  own  initial  opinions.  In  our  research,  the  coalition  members  are  assumed  to  have  access 
to  full  profile  of  the  underlying  graph  of  the  network  as  well  as  the  initial  opinions  of  all  other  individuals. 
We  establish  the  existence  of  a  minimum  size  EGC  and  develop  a  non-trivia!  set  of  upper  and  lower  bounds 
on  that  size.  Thus,  even  when  the  underlying  graph  does  not  guarantee  convergence  to  a  global  or  multiple 
consensus,  a  generally  restricted  coalition  of  individuals  can  steer  public  opinion  towards  a  desired  con¬ 
sensus  provided  they  can  cooperatively  adjust  their  own  initial  opinions.  Moreover,  we  provide  geometric 
insights  into  the  structure  of  EGC’s.  Our  results  are  also  extended  to  the  discrete  time  case  where  the  relation 
with  Decomposition-Separation  Theorem  is  also  made  explicit. 
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